A DIMENSION FORMULA FOR EKEDAHL-OORT STRATA 



by Ben Moonen* 

To an abelian variety X over a field k of characteristic p we can associate invariants such 
as the p-rank or the isogeny class of its p-divisible group. Such invariants can be used to define 
stratifications of the moduli space s/ g in characteristic p. One example of such a stratification is 
the Newton stratification. Two points of srf g (k) are in the same Newton stratum iff the associated 
p-divisible groups are isogenous over k. Mainly through the work of de Jong and Oort [3] and 
Oort [12], we now have a fairly complete picture of this stratification. For an overview we refer 
to Oort [14] or Rapoport's Bourbaki lecture [15]. 

Of more recent date is the EO-stratification, after Ekedahl and Oort. The starting point 
is that, given g = dim(X) and working over k = k with char(/c) = p, there is a finite list 
of isomorphism classes of group schemes X[p\. This was proven by Kraft [9] (unpublished), 
was seemingly forgotten for some time, and was then reobtained by Oort around 1995. The 
EO-stratification is defined by declaring that two points of s$ g {k) are in the same stratum 
iff the associated group schemes X\p] are isomorphic over k. Several basic properties of this 
stratification were obtained by Ekedahl and Oort; see Oort [13]. Other questions, such as which 
strata occur in the boundary of a given one, remain open. 

Naturally, people have tried to extend these theories to other Shimura varieties. A good 
class to start working on are the PEL moduli spaces at primes of good reduction. A generalized 
Newton stratification can be defined using the theory of isocrystals with additional structure, 
developed by Kottwitz [7] and Rapoport and Richartz [16]. The picture is, at present, still much 
less complete than in the Siegel modular case, though; see [15], §5. 

Work on the generalized EO-stratification was taken up by Wedhorn [17] and the author [10]. 
(The Hilbert modular case was studied by Goren and Oort in [5].) The data that are fixed in the 
moduli problem give rise to an algebraic group G and a conjugacy class X of parabolic subgroups. 
The "p-kernel" objects to consider are triples Y_ = (Y, i, A) consisting of a group scheme Y killed 
by P, equipped with an action i of a semi-simple F p -algebra and a polarization A: Y — ► Y D . 
Writing Wq for the Weyl group of G and Wx C Wq for the subgroup associated to X, the 
main result of [10] is that, fixing suitable discrete invariants, such triples Y_ are classified by the 
Wx-cosets in Wq. Wedhorn showed in [17] that this leads to a generalized EO-stratification on 
good reductions $4$ of PEL moduli spaces. More precisely, fc-valued points of s^q naturally give 
rise to triples Y_ as above, and with the appropriate assumptions we arrive at a stratification 
£/o = U weWx \ Wc £/ (w). Also in [17] we find a result about the dimension of the strata: If Y_ w 
is the triple corresponding to the coset w S W\\Wg and if M)(w) ^ 0, then every irreducible 
component of £/q(w) has codimension equal to dim (Aut(y^)) in g/ . 

The main purpose of the present paper is to give an explicit dimension formula for the 
strata. To state the result, let us recall that once we fix a generating set of reflections S C Wg, 
every coset w G Wx\Wg has a distinguished representative w. The actual element tb depends 
on the choice of S, but its length £(w) does not. Our main result is then the following. 
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Theorem. — If g/ (w) ^ then its irreducible components all have dimension equal to £(w). 

The strength of this formula lies in the fact that the lengths £(w) are easily computable. 
In particular, an immediate consequence of our result is that there is at most one O-dimensional 
stratum and that there is a unique stratum of maximal dimension. The latter takes the role of a 
generalized ordinary stratum and plays a central role in our paper [11], in which a generalization 
of Serre-Tate theory is developed. 

As suggested by the above, what we really compute in this paper are the dimensions of the 
automorphism group schemes Aut (Y_) . These computations are based on an explicit description 
of the Dieudonne modules of triples Y_ as in the above. The classification results of [10] are 
recalled in §1, the actual computation of the dimension of Aut(Y) is done in §2. The application 
to the study of EO-stratifications is discussed in §3. 

Acknowledgements. I thank F. Oort, R. Pink and T. Wedhorn for stimulating discussions on the 
subject of this paper. The research for this paper was made possible by a Fellowship of the Royal 
Netherlands Academy of Arts and Sciences (KNAW). During my work on this paper I have been 
affiliated to the University of Utrecht (until June 2001) and the University of Amsterdam (from 
July 2001). I thank these institutions for their support. 

§1. p-Kernel group schemes with additional structures 
1.1. Generalities on BTi. 

We fix a prime number p. When dealing with polarized group schemes we assume p ^ 2. 

1.1.1. Let S be a scheme. Write So C S for the closed subscheme defined by the ideal (p) C Os- 
By a BTi over S (short for "truncated Barsotti-Tate group of level 1") we mean a commutative 
finite locally free S'-group scheme Y such that, with the notation Y := Y x s So, the sequence 

is exact. Here F and V denote the relative Frobenius and Verschiebung of Yq over So- For 
further details see Illusie [6]. 

If Y is a BTi over S then we write Y D for its Cartier dual. There is a canonical isomorphism 
Y —> Y DD , which we take as an identification. If e G {±1} then by an e-duality of Y we mean 
an isomorphism A: Y Y D such that A = e ■ \ D . Such an e-duality induces an involution 
/ h> /t on the ring Ends(Y). We also refer to an e-duality as a polarization. 

1.1.2. Let B be an F p -algebra. By a BT\ with B-structure over a basis S we mean a pair 
Y_ = (Y, i) where Y is a BTi over S and t: B — > Endg(Y) is a homomorphism of F p -algebras. 

Suppose B is equipped with an F p -linear involution b i— » b* . Let e € {±1}- By a BT\ with 
(B, *, e)-structure over S we mean a triple Y = (Y, i, A) where (Y, i) is a BTi with S-structure 
and A: Y —> Y D is an e-duality, such that t(b*) = t(6) t for all b G B. 

1.1.3. We use contravariant Dieudonne theory as in Fontaine [4]. Let K be a perfect field, 
char (If ) = p. Then a BTi with .B-structure over K corresponds to a 4-tuple (N, F, V, i), where 
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— N is a finite dimensional K-vector space, 

— F: N — > N is a Frob^-- linear endomorphism, 

- V: N — > A" is a Frob^ -linear endomorphism, and 

— i: B —> End(A^, F,V) is an F p -linear homomorphism, 

with Ker(F) = Im(F) and Im(F) = Ker(V). Using these last relations one can show that there 
exists a filtration 

V.: (0) =^ C^i Crf 2 C ••• C^ r = N 

that is the coarsest filtration with the properties that 

(i) for every j there exists an index f(j) £ {0,1, ... ,r} with Fi^£j) = ^f{j)', 

(ii) for every j there exists an index v(j) G {0, 1, . . . , r} with = ^(j). 
We refer to this filtration as the canonical filtration of N. See also [10], 2.5. 

Similarly, a BTi with (B, *, e)-structure corresponds to a 5-tuple (N,F,V,ip,i), where 

(N,F,V,i) is as above and where (p: N x N — > K is a perfect, e-symmetric bilinear form, 
such that 

(1.1.3.1) <p(Fni, n^) = ip(ni, Vn^f for all n\ , n 2 € A^; 

(1.1.3.2) (p{bni,n2) = tp(n\,b*n-2) for all 6 € B and rai, n 2 € A 7 ". 



1.2. BTi with given endomorphisms. 

Let B be a finite dimensional semi-simple F p -algebra. Let k be an algebraically closed field of 
characteristic p. The first problem studied in [10] is the classification of BTi with B-structure 
over k. This generalizes the work of Kraft [9], who classified group schemes killed by p without 
additional structure. We shall briefly review our results. 

1.2.1. Write k for the center of B. Then n is a product of finite fields, say k = k,\ x • • • x k v . 
Let / = /iU'"U J'n be the set of homomorphisms k — > k. 

Consider pairs (N, L) consisting of a finitely generated B ®f A;-module A" and a submodule 
L <Z N . Note that the simple factors of B k are indexed by J? ', so we get canonical 
decompositions A" = ® i€ ^Ni and L = © ig ^Li. Define two functions d, f: J" — > by 
d(z) = length(A r i ) and f(i) = length(Lj), takings lengths as 1? (8>f p /c-modules. The pair (d,f) 
determines the pair (N, L) up to isomorphism. 

To the pair (N, L) we associate an algebraic group G over k and a conjugacy class X of 
parabolic subgroups of G. First we define 

G := GL B0 F fc(AT) = n GL d ( i ) jfc . 

Then the stabilizer P := Stab(L) is a parabolic subgroup of G, and we define X as the conjugacy 
class of parabolic subgroups of G containing P. 

1.2.2. Let Y_ = (Y,l) be a BTi with S-structure over k. Write AT for the Dieudonne module 
of Y and let L := Ker(F) C N. Let [d, f) be the corresponding pair of functions. It can be 
shown (see [10], 4.3) that the function d is constant on each of the subsets J^ n C . We refer 
to (d, f ) as the type of (Y, i) . 
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1.2.3. Fix a pair (d, f) with d constant on each subset J^ n C J 1 . Fix a pair of B (g) F fc-modules 
Lq C Ag of type (d, f). Let (G,X) be the associated algebraic group and conjugacy class of 
parabolic subgroups. Let VF^ be the Weyl group of G, and let Wx C Wq be the subgroup 
corresponding to X. 

To a pair Y_ = (Y,i) of type (d, f) we associate an element u>(H) £ Wx\Wg. This is done 
as follows. Write N for the Dieudonne module of Y and let L := Ker(F) C N. Choose an 
isomorphism £: N — > Nq that restricts to L — ► Lq. This allows us to view the canonical 
filtration of A^ as a filtration of -/Vo- Choose any refinement of to a complete flag. The 
relative position of L and is given by an element w(L ,JP.) G Wx\Wg- It can be shown 
that this element is independent of the choice of £ and the refinement see [10], especially 4.6 
for details. Now define w(Y_) := w(Lq,^.). 

With these notations, the first main result of [10] can be stated as follows. 

1.2.4. Theorem. — Assume that k = k. Fix a type (d,f). The map Y_ h-> w(Y_) gives a bijection 

( isomorphism classes of 
I 11 of type (d,f) 

1.3. BTi with given endomorphisms and a polarization. 

Let B be a finite dimensional semi-simple F p -algebra equipped with an involution b i— > b* . Let 
e E {±1}- Let k be an algebraically closed field of characteristic p > 2. The second problem 
studied in [10] is the classification of BTi with (B, *, e)-structure over k. We shall briefly review 
the result. As in section 1.2, this involves an algebraic group G. In the polarized case there 
are two versions of the result: one using a possibly non-connected group G, the other using 
the identity component G°. We shall need both variants; see 1.3.6-1.3.8 below; see also [10], 
especially 3.8 and 5.7. 

1.3.1. Let (B, *,e) be as above. We can decompose (B, *) as a product of simple factors, say 

(£,*) = (£i,*i) x ••• x (B„, *„) . 

If * ra is an orthogonal involution, set e n := +1; if *„ is symplectic, set e n := —1. The simple 
factors (B n , * n ) come in three kinds: 

Type C: B n = M r (n n ) for some finite field n n , with * n of the first kind and e ■ e n = —1; 
Type D: B n = M r (n n ) for some finite field n n , with * n of the first kind and e ■ e n = +1; 
Type A: B n = M r (k n ), where k n is an etale quadratic extension of a finite field tz n , and * n is 
of the second kind. 

Note that the labelling depends on e. For factors of type A, if n n = ¥ q then either k n = ¥ q 2 or 

Let k be the centre of B, and define k := {z € R \ z* = z}. We have R = R\ x • • • x R v and 
k = K\ x • • • x k„, where the n n are finite fields, R n = n n if (B ra , * n ) is of type C or D, and K n is 
an etale quadratic extension of n n if * n ) is of type A. Let / = /i U • • • U be the set of 
homomorphisms k — > fc. For X € {A, C, D} we say that i € is of type X if i G C and 
(B n , *„) is of type X. Let C / be the subset of elements of type X. Let J? be the set of 
homomorphisms R — > fc. We have a restriction map res: — > J" . For r € define f := r°*. 
If i € is of type C or D then there is a unique r € with res(r) = i, and r = f; if i is of 
type A then there are precisely two elements r, f € that restrict to the embedding i on k. 



W X \W G . 



4 



1.3.2. Consider triples (N, L, <p) consisting of a finitely generated B ®f fc-module N, a perfect, 
e-symmetric bilinear form p: N x N — > k satisfying (1.1.3.2), and a maximal isotropic submodule 
L C N. With a similar construction as in 1.2.1, such a triple is classified, up to isomorphism, 
by a pair (d, f) consisting of functions d: J* — ► and f: ,f — > such that f (r) + f (f) = 

for all r G and % = res(r) € J 1 . Note that if i is of type C or D then there is a unique r = f 
with res(r) = i and we get the relation d(i) = 2f(r). 

To a triple (N,L,p) as above we associate a pair (G, X). First, define G := U£ig) Fp fc(iV, </?), 
the algebraic group (over k) of B <8>f fc-linear automorphisms of A" that preserve the form 99. 
We have G = Y\ i€J fGi, with Gj isomorphic to Sp d ^ k if i is of type C, to O d ^ tk if i is of 
type D and to GL^,)^ if i is of type A. Note that d(i) is even if i is of type C or D. In the 
presence of (non-connected) orthogonal factors, the set X that we want to consider is not simply 
a conjugacy class of parabolic subgroups of G. Instead we consider (partial) hermitian flags 
in N, i.e., nitrations by B ®$ /c-submodules 

(0) = C C Ci C • • • C a = N 

with the property that Cf = C r - j for all j. (Here Cf := {n £ N \ <p(Cj,n) = 0}.) The 
set Flag (AT, y?) of all such hermitian flags has the structure of a (generally non-thick) building, 
on which G acts in a strongly transitive, type-preserving manner. Then we define X to be the 
G-orbit in Flag(A r , p) of the flag (0) C L C N. Equivalently, X is the set of all maximal isotropic 
subspaces in N. Note that if there are no factors of type D then C. 1— > Stab(C) gives a bijective 
correspondence between hermitian flags and parabolic subgroups of G; in this case we could also 
define X to be the conjugacy class of parabolic subgroups of G that contains Stab(L). 

1.3.3. Let y be a BTi with (B, *, e)-structure over k. Let Af be the Dieudonne module of Y, 
let L = N[F] := Ker(i ? ), and let (p be the e-hermitian form on A^ corresponding to the given 
e-duality. Then (N, L, <p) is a triple as in 1.3.2. Let (d, f) be the corresponding pair of functions; 
we refer to this pair as the type of Y_. It can be shown ([10], 4.3, 5.3 and 6.5) that the function d 
is constant on each of the subsets ^ n C J r . 

1.3.4. Fix (d,f) as in 1.3.2, with d constant on each subset J^ n C J' . Choose a corresponding 
triple (No,Lo,ifo). To this triple we associate a pair (G,X) as explained above. The Coxeter 
group associated to the building Flag(A r , fo) is just the Weyl group Wq of G. Note, however, 
that we work with a possibly non-connected group G; an orthogonal factor 2q contributes a 
factor of type B g (not D g ) to Wq. Write Wx C Wq for the subgroup corresponding to X. 

Let y be a BTi with (B, *, e)-structure over k of type (d, f). Let (N, L, ip) be the associated 
triple, as in 1.3.3. To Y_ we associate an element w(Y_) € Wx\Wq. This works essentially 
the same as in the non-polarized case. First we choose an isometry £: (N,ip) —* (N , tp ) that 
restricts to L L . Via £ we can view the canonical filtration c €, as an element of Flag(A r , ipo)- 
Choose a refinement of to a full hermitian flag in A^. (I.e., choose a chamber of which 
is a face.) The relative position of Lq and is measured by an element w(Lq,^.) E Wx\Wq- 
It can be shown that this element is independent of the choice of £ and the refinement ; see 
[10], especially 5.6 and 6.6 for details. Now define w(Y_) := w(L ,J?.). 

With these notations, the second main result of [10] is the following. 

1.3.5. Theorem. — Let k be an algebraically closed field, char(fc) > 2. Fix a type (d,f). Sending 
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a BTi with (B, *,e)- structure Y_ to the element w(Y_) gives a bijection 

J isomorphism classes of] 
\ yoftype(d,f) 



W X \W G . 



(In [10] this result is only stated for BTi with (B, *, — l)-structure. However, by Morita 
equivalence one can always reduce to the case that e = — 1.) 

1.3.6. We describe a variant of the theorem that uses the Weyl group of the identity compo- 
nent G°. To explain this we need to introduce another invariant, which is a function 8: J? — > 
Z/2Z. If there are no factors of type D then ^ D = and the invariant 8 is void. If % G J^ D , 
let r E J? be the unique element with res(r) = i. As we have seen, the Dieudonne module N 
decomposes as N = ® Te jN T . Let N T [F] := Ker(F|jvJ and N T [V] = Ker(Vjjv T ). Now define 
5(i) to be the length of the B ® Fp fc-module N T [F]/(N T [F] n N T [V]) modulo 2. 

As in the above, let G := U B® ¥p k(No, fo)- Define X° to be the conjugacy class of parabolic 
subgroups of G° containing Stab(L ). Write Wqo for the Weyl group of G°, and let W x o C Wqo 
be the subgroup corresponding to X°. 

In addition to the type (d,f), also fix 5: J^ D -> Z/2Z. Let Y be a BTi with (B,*,e)- 
structure of type (d, f, S). With a similar procedure as above we associate to Y_ an element 
w°(Y_) € Wxo\Wqo. (If there are no factors of type D then w (Y_) is just the same as w(Y_).) 

With these notations we have the following variant of Thm. 1.3.5. 

1.3.7. Theorem. - Let k = k, char(fc) > 2. Fix a type (d, f, 8). Then the map Y_ \— > w (Y_) 

gives a bijection 

{ isomorphism classes of] ^ 

| Y of type }— ^,\»' .. 



1.3.8. If m = then #(W x \^g) = 2 m • #(W x o\W G <')- This corresponds to the fact that, 

given (d, f), there are 2 m choices for <5. 

In some applications it is more convenient to work with the element w(Y_); in other cases 
w°(Y_) is easier to use. At any rate, once we fix 8 we have a bijection 

felements of type <5] ~ . 
that can be made completely explicit. For details we refer to [10], 3.8. 



§2. Automorphism group schemes 
2.1. Statement of the main result. 

2.1.1. Let (W, S) be a Coxeter system, X C S a subset, Wx C the subgroup generated by X. 
Write i for the length function on W. Every coset w £ Wx\V^ has a unique representative 
w of minimal length, called the (X, 0)-reduced representative. (See Bourbaki [2], Chap. IV, 
Exercise 3.) If Wx C W and w € Wx\W^ are given then -ti; in general depends on the choice 
of S, but £(w) := £(w) is independent of S. 

This section is devoted to the proof of the following result. 
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2.1.2. Theorem. — (i) Let B be a finite dimensional semi-simple ¥ p -algebra. Let Y_ be a BTi 
with B -structure over a field k = k with char (A;) = p. Let (d, f) be the type ofY_, define G and X 
as in 1.2.1, and let w := w(Y_) £ Wx\Wq- Then the automorphism group scheme Aut(Y) has 
dimension equal to dim(X) — £(w). 

(ii) Assume that p > 2. Let * be an involution on B and let e £ {±1}- Let Y_ be a BT\ 
with (B,*,e)- structure over k. Let (d,j,S) be the type ofY_, define G° andU as in 1.3.6, and 
let w° := w°(Y_) £ Wxo\Wgo. Then the automorphism group scheme Aut(Y) has dimension 
equal to dim(X°) -£(w°). 

2.1.3. Let S be a scheme of characteristic p. Following Wedhorn [17] we define a Dieudonne 
space over S to be a triple (iV, V'") where N is a locally free ^5-module of finite type and 
where F»: N&> -» N and V b : N -> N&> are ^-linear homomorphisms such that =0 and 
y b oF» = 0. (We use F and V for semi- linear endomorphisms, F^ and V for their linearizations.) 

In the following, @ will either denote a finite dimensional semi-simple F p -algebra 6 or a 
triple (B,*,e) as in section 1.3. We have the notion of a Dieudonne space with i^-structure 
over S; see [17], § 5 for details. 

Let Y_ be a BTi with ^-structure over k. The Dieudonne module of Y_ defines, by lin- 
earization of F and V, a Dieudonne space with ^-structure N_ over k. Both Y_ and TV give 
rise to an automorphism group scheme. Concretely, if /: T — > Spec(fc) is a /c-scheme then 
the T- valued points of Aut(F) are the automorphisms of the pull-back f*(Y_) as a BTi with 
^-structure over T. Similarly, the T- valued points of Aut(iV) are the automorphisms of the 
pull-back f*(N_) as a Dieudonne space with ^-structure over T. 

We shall make use of the following result of Wedhorn. 

2.1.4. Proposition (Wedhorn, [17]). — Notations as above. There is a natural homomorphism 
of k- group schemes 

A: Aut(y) — ► Aut(TV) . 

If K is any perfect field then A induces an isomorphism on K -valued points. This implies that 
dim (Aut(Y)) = dim (Aut(AQ) . 

Strictly speaking, [17] only deals with polarized BTi. In the non-polarized case the same 
arguments apply. Alternatively, one can reduce to the polarized case by passing from a BTi 
with 73-structure Y_ to Y x Y D with its natural B x i?-structure and the obvious e-duality. 

To prove Thm. 2.1.2 we shall compute the dimension of Aut(iV). Let us note that Aut(Y) 
and AutQV) are in general non-reduced (see also 3.1.7), and that A is in general not an isomor- 
phism. 

2.2. The non-polarized case. 

2.2.1. We first prove (i) of Thm. 2.1.2. The notions involved in the proof are illustrated in an 
example in 2.2.12 below. There is an easy reduction to the case that B = re is a finite field. In 
fact, as the Brauer group of a finite field is trivial we have B = M ri (rei) x • • • x M Tv (re„) where 
the re n are finite fields. Fixing such an isomorphism, every BTi with 75-structure decomposes 
as a product Y_ = (Hi) ri x • • • x (Y_ u ) r » , where Y_ n is a BTi with re„-structure. If the theorem 
holds for each Y_ n then one readily checks that it also holds for Y_. 
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2.2.2. Suppose B = k is a field of p m elements. Recall that we write J? for the set of embeddings 
k — > k. Then J? is a set of m elements that comes equipped with a natural cyclic ordering: if 
i G J? then we write i + 1 for Frob^ °i. 

A type (d, f) consists of a positive integer d and a function f: — > {0, . . . , d}. As in 1.2.1 
we associate to the type (d, f) a pair (G, X); in this case we have G = Yl ieJ ?GLd t k- After a 
suitable choice of coordinates we can identify 

W G =U&d and W x = n 6{l,...,f(*)} x 6{f(t) + 1, . . . ,d} . 

In each factor 6^ we take the transpositions (j j + 1) as a set of generators. 

As recalled in 2.1.1, each coset w G Wx\Wq has a distinguished representative w = (w\)i^j 
in Wq. The permutations Wi that arise in this way are characterized by their property that 

(2.2.2.1) f < j and w,{j') > w^j) => w^j) < f(i) < w,{j') . 
The length of the element w is given by l(w) = ^(^i)> with 

(2.2.2.2) ^ ) = ^(^( n )-n)= £ (n - ™r V)) ■ 

n=l ra=f(i)+l 

2.2.3. Let w = w(Y) G W X \W G . Let JV = (N,F,V,i) be the Dieudonne module of Y. We 
recall from [10], 4.9 an explicit description of N_ in terms of the distinguished representative w. 
Namely, let N be the fc-vector space with basis e^j for i G and j G {l,...,d}. Write 
ATj := X^=i & " e i,j) so that iV = ® ieJ pNi. We let a G k act on Ni as multiplication by i(a). 
Next define Frobfc-linear maps F: Aj — > A/j+i and Frob fc -linear maps V^: A 7 * <— Aj+i by 

iftfitf)<f(i); and 1 .) = /° if i^ d "f«; 

e i+ i,„ if = f(i) + n; 1 \ e i)Tl if j = d - f(i) + w^n). 

This defines a Dieudonne module with K-action such that the corresponding BTi is isomorphic 
to Y. 



2.2.4. We find it useful to draw pictures of the Dieudonne modules N obtained in this way; see 
Figure 1. The boxes represent base vectors as indicated. An edge connecting boxes and 
(i + l,f) either represents the relation Ffej) = (an F-edge) or the relation V(ei+iji) = 

eij (a V^-edge). To determine in which of the two cases we are we represent the base vectors 
eij with F(ei t j) = by shaded boxes; thus in the module Ni there are f(i) shaded boxes. Note 
that in most cases we do not need the shading: (2.2.2.1) implies that two edges of the same kind 
never cross. Since the image of F: Ni — > N i+1 is spanned by the first d — f(i) base vectors, it 
follows that an F-edge in the picture always has slope ^ and a F-edge always has slope ^ 0. 
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In the example drawn in Figure 1 we take d = 5 and m = 4, with f(z — 1) = 1, f(z) = 3, 
f(i + 1) = and f(i + 2) = 3. The distinguished representative w is given by 



Wi 



1 2 3 4 5 

2 13 4 5 



Wi 



1 2 3 4 5 
1 4 5 2 3 



W i+1 = W i+2 



1 2 3 4 5 
1 2 3 4 5 



One should think of TV as a roundabout (carousel); note that in Figure 1 (with #<y = 4) the 
summands iVj_i and N i+3 have to be identified. 

2.2.5. We recall some facts proven in [10], Lemma 4.5. The canonical filtration of N = ® ie j?Ni 
induces nitrations 

Ci. : (0) = C li0 C Ci,i C • • • C C iJt = Nt . 

In the description of N given in 2.2.3, if n = dim(Cj iT -) then d )T = k ■ e^i + • • • + k ■ e^ n . 
The length I of the filtrations Ci. is independent of i e /. We refer to the vector spaces 
B it j := Cij/Cij-i as the canonical blocks of N; they are indexed by the set si := J* x 
{1, ...,£}. For each pair G si there is a unique index Pi(j') € {!,...,£} such that 

either: i^: TVj — > A^+i induces a Frobfe-linear bijection B^- — > B i+1 ^ p .^^ 
or: V^: A 7 , <— AVi-i induces a Prob^" 1 -linear bijection B it j Bi+i, Pi (j)- 
Then p(i,j) = (i + l,Pi(j)) defines a permutation p of the set and for each a = (i,j) G =2/ 
we have a Frobfc-linear bijection i a : B a — ► Bp(a) which is either induced by Fj or is the inverse 
of the bijection induced by 

If / G Aut QV)(J?) for some fe-algebra B then / preserves the filtrations Q .. This allows 
us to define a normal subgroup scheme J7 C Aut(iV) by 

17(12) := {/ G Aut(A[)(B) | gr a (/) = id Ba for all a G si}; 

see also [10], 5.11. 

2.2.6. Lemma. — The identity component of AutQV) zs contained in U. 
Proof. By construction, U is the kernel of the homomorphism 

h: AutQV) — n GL(B a ) given by / -> (gr (/)) . 

It suffices to show that /i factors through a finite etale subgroup scheme of Y[ GL(B a ). 

Take a e si, and let r be the smallest positive integer such that p r (a) = a. The composition 

■= (B a ^p(a) P< > • • • — " ^ ^P r (a) = B a) 

is a Frob^-linear automorphism of B a . Then ^ a := {b G B a | =5^(6) = 6} is an F p r-subspace 
of B a such that the natural map 38 a (% pr k — > B a is an isomorphism. It follows that the 
subgroup scheme Ten GL(B a ) given by the automorphisms that commute with all SF a is 
finite etale. On the other hand, if / G Aut (TV) then for every a G si we have the relation 
gr p ( a ) (f)°t a = t a °gr a (f). Iterating this we find that gr Q (/) commutes with 3? a . Hence h factors 
through r. □ 

As we shall see later, U is connected; hence it is the identity component of Aut(iV). 
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2.2.7. We describe the group scheme U in more detail; see also [10], 5.11. Let R be a /c-algebra, 
and let / G Aut(N_)(R). Then / respects the decomposition N (g> R = ® ie j;Ni <X> R. Write 
Af(i,j',j) for the (J',j)-th matrix coefficient (with respect to the basis e^j) of the automorphism 
of Ni <g) R induced by /. Clearly / is fully determined by the map Af-.yx{l,..., d} 2 — > R. 
Our task is to describe which maps A: J> x {1, . . . , d} 2 — > i? arise as ^4/ for some f € U. The 
first obvious condition is that for all / G £7 the map A = Af satisfies 



(2.2.7.1) 



A(i,/,j)=0 if/>j,and A(i,j',j) = l iij'=j. 



Consider the set J* x {l,...,d}. Given there is a unique index ti(j) G {l,...,d} 

such that either Ffej) = e i+ i tt .(j) or e^j = F(ej + i it .(j)). The ij are permutations of {1, . . . , d}. 
Given f (i) we can easily compute ti from ibi and vice versa; see the formulas for F and V in 2.2.3. 
When we draw a Dieudonne module as in Figure 1, it is the permutations ti that we "see" in the 
picture. Write T for the permutation of J* x {1, d} 2 given by T(i,j',j) = (i+ 1, . 

Let (io,f ,jo) £ r y x {l,...,d} 2 . For n G Z write (i„,j' n ,j„) := T n (i , f , j ). Suppose 
Jo < Jo- We can think of the triple (iojJo>Jo) as a pair of base vectors ej 0iJ ^ and ej 0iJO with 
e iniJ / "below" ei 0iJn . Going from (ioiJoiJo) to («i, jj, ji) there are four possible configurations, 
as shown in Figure 2. (For the interpretation of these illustrations see 2.2.4; cf. also the figures 
in [10].) In cases 1 and 2 we say that T is parallel at (iojJo>Jo); in case 3 we say T is down-up, 
in case 4 we say it is up- down. 



1 (parallel): 

F ( e io,j' ) = e : 



i,3i 



2 (parallel): 

e i ,3' = V ( e ii,3[) 
e io,jo = V( e ii ,31 ) 



3 (down- up): 



i,3i 



4 (up-down): 

F ( e io,j' ) = e ii,3\ 
e io,jo = V( e ii,3i) 




J ii ,3i 




^o,3o 




H,3i 




Figure 2. 



2.2.8. Lemma. — Suppose given a map A: x {1, . . . ,d} 2 — > R that satisfies (2.2.7.1). Then 
A = Af for some f G Aut QV)(i?) if and only if the following two conditions are satisfied for all 

(ioJ'oJo) w it h Jo < Jo-' 

(2.2.8.1) ifT is parallel at {i ,j' ,jo) then AfaJ'^ji) = A(i , f , j ) p ; 

(2.2.8.2) ifT is up-down at (i ,j' Jo) then A(i ,f ,j ) p = 0. 

Proof. First suppose that A = A f for some / G Aut(N)(R). That (2.2.8.1) and (2.2.8.2) hold 
is immediate from the fact that / is compatible with the linear maps F^ and V b . (See 2.1.3 for 
notation.) For instance, suppose T is up-down at («o> Jo>Jo)- Writing out elements on the basis 
ei ,i, - - - ,e i0! d we have 

f( e io,jo) = e io,h + ■■■ + A(i ,j' ,j ) ■ e i0ii j + ■■■ . 
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Applying to both sides, and using that F$of(p) = f°F$, we find a relation = + • • • + 

MioJoJoY • H . So indeed A(i , j , jo) p = 0. 

Conversely, suppose / is a k (8>f p -R-linear automorphism of A such that the corresponding 
matrices A(i,j',j) satisfy (2.2.7.1), (2.2.8.1) and (2.2.8.2). We have to verify that / is compatible 
with and V b . To check the compatibility with V b , let us consider a base vector ei 1 ^ 1 . Note 
that for each i the image of iVj_i — > Aj is spanned by the first d — f(i — 1) base vectors 

eij. Hence if V b (ei 1 j 1 ) = then also V b (e il j' i ) = for all j[ < ji, and it follows that 
f ( - p ^V b (ei 1 j 1 ) = = V b f(ei 1 j 1 ). The other possibility is that V b (ei 1 j 1 ) = ej 0iJ0 . In this case we 
have 

y b f(e iujl ) = e i0)io + Y A (h,j[,ji) ■ V(e iuri ) . 
j[<ji 

If 3i < 3i, wr ite j[ = U (j' Q ). Either j' > j , in which case T is down-up at (i ,j' ,j ) and 
v ( e ii,j[) = °> or io < Jo> in which case T is parallel at (io,j' ,jo) and (2.2.8.1) gives A(i 1 ,j[,j 1 ) = 
A(i ,j' ,jo) p . Combining this we find that f^V b = V b f. We leave it to the reader to verify, in 
a similar manner, that F»o/(p) = foFK □ 

2.2.9. As before, suppose j' < jo- It can be shown (see [10], 4.16 and 4.19) that T is parallel 
at {in,j' n ,jn) for all n £ Z if and only (io Jo) and (io, Jo) belong to the same canonical block, by 
which we mean that there is an index r such that e io j> and e io . JO both lie in Ci Q>r \Ci 0jr -i. Hence 
in order to have A = Af for some / 6 U, the map A should satisfy the additional requirement 

(2.2.9.1) if Jo < jo and T is parallel at (in,j' n Jn) for all n then ^(i , J , Jo) = 0. 

2.2.10. To summarize our conclusions, let us define a track in J? x {1, ... , d} 2 to be a sequence 

{ioj'oJo), (k,j'i,ji), {ibj'bJb) 

with {i n ,fn,jn) = T n (i ,jb,jo) for all n, such that 

- Jn < Jn for all ^ n ^ 6; 

— T is parallel at (i n ,j' n ,jn) for all ^ n ^ 6 — 1; 

— T is not parallel at (ib, j' b , jb)', 

- T is not parallel at j^, j_ x ) := T~ 1 (i , J ) jo) ■ 

We call {io-ifoijo) the start of the track, {ib, j'b-, jb) its end, and 6 its length. If T is up-down 
at {ibij'bijb) then we call the track a ud-track; if T is down-up at (ib,j'b,jb) then we call it a 
du-track. 

Suppose there are [i different du-tracks in x {1,... , <i} 2 and that there are v different 
ud-tracks, of lengths b\,...,b v . Then we find an isomorphism of fc-schemes 

U Spec(fc[xi, . . . ,x M ,yi, . . .,y u }/(y p 1 ,.. .,y£")} 

by associating to / £ J7 the matrix coefficients A(io, jb, jo) for all starting points (io,jb,3o) of 
a track. In particular, C7 is connected, and together with Lemma 2.2.6 it follows that U = 
Aut(A) . 
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2.2.11. To compute fi = dim(C7) we count the du-tracks by their end points. These end points 
are simply all triples at which T is down-up. Hence if for i E / we define 

S(i) : = | 1 < f < j ^ d,F{ei,j,) = and F + 0} 

= \Kf<j<d and m(f) < f(i) < wi(j)} 

then the result is that dim(U) = # S< S)- lt follows from (2.2.2.1) that if Wi(f) = n < f(i) 

then there are — n elements in the range 1, . . . , f for which Wi takes a value > f(i). So there 
are [d — f(i)) — (j' — n) elements j such that G S(i). This gives, using (2.2.2.2): 



n) — n) 



n=l 



= f(i)- (d-f(i)) -^K- 1 (n)-n) = dim(X,)-£(u; i ), 

n=l 

which is the formula we want. □ (Thm. 2.1.2, (i).) 

2.2.12. Example. - - We consider the Dieudonne module illustrated in Figure 3; here m = 4 
and d = 4, with f(i) = 1, f(i + 1) = 0, and f(i + 2) = f(i + 3) = 2. 




i + 1 



z + 2 
Figure 3. 

The distinguished representative of the element w is given by 

Wi 



i + S 



"1 


2 


3 


4" 




"1 


2 


3 


4" 




"1 2 


3 


4" 




"1 


2 


3 


4" 


2 


3 


1 


4_ 


, w i+ i = 


1 


2 


3 


4_ 


, W i+2 = 


1 3 


4 


2 


, = 


3 


1 


4 


2 



which gives £(i&) = 2 + + 2 + 3 = 7. As dim(X) = l- 3 + 0- 4 + 2- 2 + 2- 2 = llwe should find 
a 4-dimensional automorphism group. Note that there are indeed precisely four du-tracks; they 
are the sequences 



and 



(i, 1, 4) -(» + 1,1,3) -(i + 2, 1,3); (i + 3,2,4)^,3,4); (i + 3,2,3) 



(i + 3, 1, 3) -> (i, 1, 2) - (i + 1, 1, 2) - (i + 2, 1, 2) 



A straightforward but tedious calculation shows that an automorphism of the Dieudonne module 
(over a field) is given by the four-tuple of matrices 



_ 6 ' ' 



V 
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where t, u, v and w are chosen arbitrarily, and £ and r) satisfy C p = C an d f] p = V- So we indeed 
find a 4-dimensional automorphism group. The identity component U C AutQV) corresponds 
to setting ( = rj = 1. Note that the variables t, u, v and w, and the places where they occur 
in the above four-tuple of matrices, correspond exactly to the four du-tracks. Note further that 
this only describes the points of AutQV), which is non-reduced, with values in a field; as there 
are seven ud-tracks the Lie algebra of AutQV) has dimension 4 + 7 = 11. 

2.2.13. Retaining the notations used above, we find that AutQV) ^ = as schemes. The iso- 
morphism is obtained by sending a point of U = AutQV) ° ed to the matrix coefficients A(i (h j' ,j ) 
for all triples (io,j' ,jo) that form the start of a du-track. If (i n ,j' n ,j n ) = T n (i , j' ,jo) then we 
have seen that A(i n ,j' n ,j n ) = A(i ,j' ,j ) p . As a result, when we identify the Lie algebra of 
GL K ® k (N) = n ie ,y GL d>fe with Hie J' M d (k), we have 

Lie(AutQV )red ) = {(*) G M d (k) X ^ f °f * ^'f 
{ ieJ is the start of a du-track 



2.3. The polarized case. 

Throughout this section we work over an algebraically closed field k with char(fc) = p > 2. 
Let @ = (B,*,e) be a triple as in section 1.3. Let Y_ be a BTi with ^-structure over k, of 
type (d, f, 5). We write N_ = (N, F, V; tp, t) for the associated Dieudonne space with ^-structure 
and N_' := (N, F, V, t) for the Dieudonne space with S-structure obtained by forgetting the 
polarization form tp. Define (G, X) as in 1.3.2, and let (G°,X°) be as in 1.3.6. Let w := w(Y_) £ 
Wx\Wq and w° := w°(Y_) G Wx°\^g°- As explained in 1.3.6 and 1.3.8, there is only a difference 
between w and w° if there are factors of type D, and the two determine each other once we fix 
the invariant 5. 

As a general notational convention, we use a prime ' for objects obtained by "forgetting the 
polarization form <p" . E.g., we write G' := GL^® Fp fc(-/V). In particular, our convention means 
that the objects studied in section 2.2 will now appear on stage equipped with a prime. 

2.3.1. Lemma. - - We have AutQV) red = AutQV') re d n G. 

Proof. Recall that G = U B ® Pp k(N, p). Let A := AutQV') red n G. It is clear that AutQV) red C 
A C AutQV), so it suffices to show that A is smooth at the origin. Let (ilj,tnj) be artinian 
local fc-algebras with Ri/m.i = k. Let tt: R\ — » R 2 be a surjective homomorphism such that 
/ := Ker(7r) satisfies mi ■ I = 0. Let a 2 G A(R 2 ) be an element which reduces to the identity 
modulo rri2. We have to show that a 2 can be lifted to an element a\ G A{R{). 

As Aut(jV / ) re d is a smooth fc-group scheme we can lift a 2 to an i?i-valued point ot\ of 
AutQV' ) red . If a is the Lie algebra of AutQV' ) red then the set of all such liftings of a 2 is a 
principal homogeneous space under a ®k I- Our task is to show that there exists an element 
(3 G a <8>k I such that a\ := a.\ + (3 preserves the form p. 

As p satisfies (1.1.3.2), it gives rise to an involution g i-> g* on G' = GLB®k{N). It follows 
from the relation (1.1.3.1) that this involution preserves the closed subgroup scheme AutQV'); 
hence it also preserves AutQV') red . It follows that a\ is also an i?i-valued point of AutQV') red . 
By construction, a\a\ is congruent to the identity modulo /, and it follows that 7 := id — a\a\ 
is an element of a ®k I- 
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Consider the bilinear form 



^: (N <g) fe x (AT ®fc — ► i?i given by *(n, n') = tp(n, n') - tp(ain, a^n') . 

Because a\ lifts «2 and «2 preserves the form ^ takes values in /. Further, *(n,n') only 
depends on the classes of n and n' modulo mi, as mi • I = 0. In sum, ^ gives rise to a bilinear 
form tp: N x N — > I. The element 7 G a <S>k I C Ends®*; (AT) (g)*. / is the unique element such 
that ip(n,n') = 92(771,77/) for all n, n' € iV. Note that 7* = 7. 

If ai := ai + /? for some (3 £ End^^A") 0^ / then the corresponding forms ip and ip are 
related by 

t/>(t7, n') = 7/>(n, n') - <£>((/3*ai + a*/?)n, n') , 

where <5i is the reduction of a.\ modulo mi. By assumption we have a.\ = id at. As 7* = 7 and 
char(fc) / 2 we can take (3 = 7/2. This gives a lifting of a 2 as desired. □ 

2.3.2. To prove (ii) of Thm. 2.1.2 it suffices to consider the following four cases. In each case 
we further describe the possibilities for the type (d,f,S), with notation as in section 1.3. 

Case C: B = k = k'is & finite field with * = id and e = — 1. The type (d, f) is fully determined 
by a number q € Z >0 via d = 2q and f(i) = q for all i £ ,Y = Houl(k, k). 

Case D: B = k = k is a finite field with * = id and e = +1. The type (d, f) is as in Case C. 
Further we have an invariant 5, which is an arbitrary function J? — > Z/2Z. 

Case AU: B = k is a finite field, with * an automorphism of order 2 and e = 1. Let k be 
the fixed field of *. The type (d, f) consists of a positive integer d and a function 
f: Z^ with f(r) + f(f) = d for all rE/. 

Case AL: B = k = k x k with k a finite field, with (xi,x 2 )* = (x2,xx), and e = 1. The type 
(d, f) is as in Case AU. Note that in this case = J 1 II J^, where the two copies 
of ^ are interchanged under t h> f; hence f is determined by its restriction to the 
first copy of J 2 *", which is a function f: J? — > TL-^q with f(i) ^ d for all i S /. 

The reduction to these basic cases is an application of Morita equivalence. See also [10], 5.2 

and 6.2. Note that the labels introduced in 1.3.1 correspond, via Morita equivalence, to the 

above labels, with type A subdivided into two cases. 

In Case AL, every BTi with (B, *, e)-structure is of the form Y_ x Y_ D where Y_ is a BTi 

with K-structure, and where the e-duality A:7x Y_ D — ► Y_ D x Y_ is given by (7/1,7/2) ► (2/2, eyi)- 

This reduces Case AL to the study of non-polarized BTi, and one checks without difficulty that 

(ii) of the theorem follows in this case from (i). 

2.3.3. Suppose we are in Case C or Case D. We have G = \\_ ieJ ? Gi with Gi = Sp 2? fc (Case C) 
or Gi = 02 q ,k (Case D). The Weyl group of Gi can be described as 

(2.3.3.1) W Gi =M q :={aee 2q | a(j) + a(2q + 1 - j) = 2q + 1 for all j} . 

In each factor W Gi we take as generators the q — 1 elements of the form (j j + l)(2p + 1 — j 2g—j) 
together with the transposition (q q + 1). The subgroup Wx C Wq is the product of the groups 



{aeW Gt I a{l,...,q} = {l,...,q}]^e q . 
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Consider the element w G Wx\Wq- Write w = (wi) i€ jr for its distinguished representative. 
The length of w is given by £(w) = YlieJ? ^(^)) with 

h 

(2.3.3.2) £(wi) = £> + 1 - w~\q + n)) ; 

n=l 

here U G {1, . . . , q} is the largest index for which w~ 1 (q + U) ^ q. 

In Case D the structure of the Dieudonne module TV is easiest to describe in terms of the 
classifying element w G W\\Wq. However, in the result that we want to prove it is not the 
length of w that matters but rather the length of the distinguished representative of w° := 
w°(Y_) G Wx°\Wqo. The length of w° can be expressed directly in terms of w; the result is that 

h 

(2.3.3.3) £(w°) = J2^i) with ^«°) = E(9-<" 1 ^ + n ))' 

i^J n=l 

here k G {l,...,q} is again the largest index for which w~ l (q + U) ^ q. Let us further notice 
that, still in Case D, the invariant 5: <y — > Z/2Z can be read from the element w by the formula 

= #{j ^ Q | Wi{j) > q} mod 2 . 

Similar to what was done in 2.2.3 we have an explicit description of TV in terms of the 
element w. Namely, we can choose a fc-basis e^j for N, for i G and j G {1, . . . , 2g}, such that 
a G k acting on eij as multiplication by i(a) G k, and such that F and V are given by 

Fi(e itj ) = e i+ltn and V(e i+ltn ) = if Wi(j) = q + n; 
Fi{e i:j ) = and V(e i+1 , n ) = e i:j if Wi(j) = -q + n. 

The £-symmetric form (p on TV is the orthogonal sum of forms ipf. TVj x TVj — > fc. With respect 
to the basis {ej iJ }j = i ! ... i 2 g the form is given by an (invertible) anti-diagonal matrix In 
Case D we can choose our basis such that &i = anti-diag(l, . . . , 1). In Case C there is not, in 
general, a natural choice of a normal form for the &i . Note that (1.1.3.1) gives a relation between 
&i and 3>j+i. Any collection of anti-diagonal matrices {^i} ie: y satisfying the relations imposed 
by (1.1.3.1) gives a Dieudonne module with (k, id, — l)-structure, and up to isomorphism this 
object is independent of the chosen collection We refer to [10], 5.8 for details. 

Via the chosen ordered bases {e^} we may identify the Lie algebra of G' = Y\ ie j; GL2< 3) fc 
with Yli€j> M 2q (k). As we have seen in 2.2.13, the Lie algebra of Aut(TV') re d is given by 

XiC/J^Oonly if (i,f,j) 
is the start of a du-track 



Lie(Aut(TV') red ) = \ (Xi) G ft M 2q (k) 



Note that if we subdivide each matrix Xi into four blocks of size q x q, say 

Xi = 



(Xi /3i 

then for (Xj)jgj? G Lie(Aut(TV / ) re d), only the blocks (5i can be nonzero; this corresponds to the 
fact that if is the start of a track then j' ^ f(i) = q < j. 
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Write J = J q for the anti-diagonal matrix of size q x q with all anti-diagonal coefficients 
equal to 1. Given a square matrix A of size q x q, write 8 A = J ■ l A ■ J for its reflection in the 
anti-diagonal. So ( s A) tu = A q+1 _ UtQ+1 _ t . 

In the symplectic case (Case C) there are diagonal matrices Cj such that 









-J 



q o 

1 



(Here we write matrices in block form.) One computes that the Lie algebra of the symplectic 
group Sp(Ni,ifi) is then given by 

'« P\ ^ *, C.-a-C- 1 = - s 5, I3 = C~ 1 ■ 

and ° 1 = °C i - 1 -Cr 1 

anti-diag(l, . . . , 1). This gives 



sp(Ni,<pi) 



G M 2q (k) 



7 5 

In the orthogonal case (Case D), <E>, 



5 /3 • s C t 



o(Ni,(pi) 



G M 2q (k) 



»/3 = -/?,V 
and a + s 5 



"7 







,d} 2 , write := (i,2g+ 1 - 7,2g + l- / 



a /3 
.7 

Given an element € ^ x {1,. 

Observe that s (W,i)) = (hf,j)- If 

t : (ioJ'oJo), {kj'iJi), {h,j'b,jb) 

is a track, write 

s t := %io , Jo. Jo), s (*i , fi, h), ■ ■ ■ , %ib, j' b ,jb) ■ 
We claim that s t is again a track in J 1 x {1, . . . , d} 2 . This is a direct consequence of the definitions 
once we know that the permutation tj defined in 2.2.7 is an element of the group M q defined in 
(2.3.3.1). Using that Wi € M q , this can be checked using the formulas for F and V given above. 

We can now complete the proof of 2.1.2, (ii) in Cases C and D. First we do Case C. By 
Lemma 2.3.1 the dimension of Aut(AQ equals the dimension of Lie(Aut(iV') re d) r\5p K(Sjk (N, ip). 
By what was explained above this dimension equals the number of tracks modulo the equivalence 
relation t ~ s t. (The equations for sp(A r i , ifi) give one relation for every pair {t, s t} with t / s t.) 

As in 2.2.11 we count the tracks by their end points. These are the triples with 
1 ^ j' < j ^ 2q and Wi(j') ^ q < Wi{j). Precisely one of the tracks t and s t has an end point 
with j ^ 2q + 1 — j', so we impose this as an extra condition. Writing 

Sc(i) := {(f,j) I 1 < f < j < 2q + 1 - j' and w^j') ^ q < 

this gives 

dim(AutQV)) = J2#S c (i). 

Suppose j' ^ q is an index with Wi(j') = n < q. We subdivide the set {1, . . . , 2q}, and in 
each range we count the numbers of times ibi takes a value > q: 



range 


#r with Wi (r) ^ q 


#r with Wi(r) > q 




n-1 


f ~ 


f 


1 





f + l,...,2q-f 


q-f 


q-f 


2q + l- f 





1 


2q + 2- j',...,2q 


j'-n 


n-1 
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Thus, we find that there are q — j' indices j for which (j' ,j) G Sc(i)- If, as above, we let 
li G {1, . . . , q} be the largest number for which w~ l {q + U) ^ q, we get 

q-l 

#s c « = 2>+i-*vV)- 

n = l 

Combined with (2.3.3.2) this gives 

q-l i 

#s c (i) + Km) = J2(«+ 1 - + E (« + 1 - ^r'fa + n )) 

n=l n=l 

= g(<7 + l)-J> = l(<l+ 1 )/ 2 = dim(X i ). 

This proves our claim that dim (Aut(iV)) = dim(X) — £(w). 

In the orthogonal case the computation is similar. This time we have to count only the 
pairs of tracks {t, s t} with t 7^ s t. Setting 

S D (i) := I 1 ^ f < j < 2q + 1 -f and Wi (f) ^q< Wi (j)} 

we get that dim (Aut(iV)) = #*Sb(«)- Counting as above and using (2.3.3.3) gives 

h q—h 
#S D (i) + £(w°) = Y^q-w- 1 (q + n) + Y,1- ^'W 

n=l n=l 

= q 2 -^2v = q(q-l)/2 = dim(X i ), 

which is what we want. □ (Thm. 2.1.2, (ii), Cases C and D.) 

2.3.4. Finally we consider Case AU. Recall that we write for the set of embeddings of R 
into k. We have a natural 2 : 1 map res: — > J^. For t £ J?, let r := r°*. The type (d, f) is 
given by an integer <i and a function f: — > with the property that f(r) + f(r) = d for all r. 

Given (d, f), the corresponding pair of Weyl groups Wx C Wq can be described as follows. 
Let wo G &d be the permutation of order 2 given by t«o(j) = d + 1 — j. For 7r G 6^, write 
7r := t«o vr o t«o • Then 



W G = {(7T T )e U 60 



7T T = 7i> for all r , 



and 

VFx = { (tt t ) G W g I tt t {1, . . . , f(r)} = {1, . . • , f(r)} for all r} . 

Let u> = {w T ) T ^j for the distinguished representative of the coset w = w(Y_). Let f C/ 
be a subset such that precisely one member of each pair {r, f } is in For each pair {r, f} we 
have 

(2.3.4.1) £(u, r )=^) = ^(u,- 1 (n)-n) = £ (n-uvV)), 

n=l n=f(r) + l 
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and £(w) = ^ Te ag£{w T ). The dimension of X is given by 
(2.3.4.2) dim(X) = £f(r)-(d-f(T)). 

(Observe that f(r) • (d - f(r)) = f(f ) • (d - f(f )) because f(r) + f(f) = d.) 

The description of the Dieudonne module iV is much the same as in the previous cases. 
Namely, we can choose a fc-basis e T j for r G and j G {1, . . . , d} such that a G re act on e Tj3 - 
as multiplication by r(a) G k, and such that Frobenius and Verschiebung are given by 

F Ae T ,j) = e T +i,n and V(e T+ i >n ) = if u> T (j) = f(r) + n; 

Fi{e T ,j) = and V(e T+1>n ) = e T>j if w T (j) = -d + f(r) + n. 

The form <p decomposes as an orthogonal sum of hermitian forms on N T x N f (where i = 
res(r) = res(f)). We can choose the ordered basis e Tj i, . . . , e T; d, e^.i, • • • , e.f,d such that ifi is 
given by an invertible anti-diagonal matrix 3>j. As in Case C there is, in general, not a natural 
choice of a normal form for these matrices. 

For (r,j',j) G J X {1, . . . , d} 2 , write %T,j',j) := (f , d + 1 — j, d + 1 - j'). Following the 
same procedure as in 2.3.3, if t is a track we get a "mirrored" track s t. The condition that the 
form tp is preserved gives one relation for each pair of tracks {t, s t}. We find, counting the tracks 
by their end points, that 

dim(AutQV)) = ^2#S a (t), 

with 

Sa(t) = {(f,j) | 1 ^ f < j ^ d and w T (f) ^ f(r) < w T (j)} ■ 
If w T (j') = n ^ f(r) then there are d — f(r) + n — j' values of j with G <Sa(t). Hence 

f(T) f(T) 

#5 A (r) = ^ (d - f(r) + n - w-\n)) = f(r)(d - f(r)) + ^ n - <V) • 

n=l n=l 

Combining this with (2.3.4.1) and (2.3.4.2) we obtain the equality £(w) + dim (AutQV)) = 
dim(X) that we wanted to prove. □ (Thm. 2.1.2, (ii).) 



§3. Application to Ekedahl-Oort stratifications 

3.1. The Ekedahl-Oort stratification on moduli spaces of PEL type. 

3.1.1. We consider a moduli problem of PEL type with good reduction at a prime p > 2. The 
data involved are the following. 

- *) is a finite dimensional semi-simple Q-algebra with a positive involution; 
— V is a finitely generated faithful left ^-module; 

- (^"^x^^Qisa symplectic form (Q-bilinear, alternating and perfect) with the property 
that <f(bvi, v 2 ) = <p(vi, b*V2) for all b G and v\, v 2 G Y; 
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- p is a prime number > 2 such that SB ® Q p is unramified, i.e., isomorphic to a product of 
matrix algebras over unramified field extensions of Q p ; 

- Ogg is a Z( p )-order in SB, stable under *, such that Og§ ® Z p is a maximal order in ^ ® Q p ; 

- A C V ® Q p is a Zp-lattice which is also an O^-submodule, such that p induces a perfect 
pairing A x A — > Z p ; 

- := CSp(A, n GLo a ®z p (A) is the (not necessarily connected) reductive group over Z p 
given by the symplectic similitudes of (A, ip) that commute with the action of Ogg; 

- S£ is a ^(R)-conjugacy class of homomorphisms S — > S^r (with § := Resc/R G m ) that define 
a Hodge structure of type (—1,0) + (0,-1) on Ifa for which either 2vri • p or — 2iri ■ p is a 
polarization form; 

- c is the <$ (C)-conjugacy class of cocharacters of associated to SE\ concretely, if h <G SC 
then we have a cocharacter \i = fih through which z € C x acts on T -1 ' (resp. y°> _1 ) as 
multiplication by 2 (resp. by 1); 

- E is the reflex field, i.e., the field of definition of the conjugacy class c. 

3.1.2. Fix data 9 = {38,*,Y,y,Ogg,k, 5£) as in 3.1.1. Let Q be the algebraic closure of Q 
inside C. We fix an embedding Q — > Q p . Let v be the corresponding place of E above (p). We 
write Oe,v for the localization of Oe at v. 

Let C p := (Z p ). Let C p be a compact open subgroup of ^(A^), and put C := C p x C p . 
We consider the moduli problem gfg^c over Spec(OE, v ) defined by Kottwitz in [8], §5. If T is a 
locally noetherian Og^-scheme then the T-valued points of =e^,c are the isomorphism classes 
of four-tuples A = (A,\,L,fj) with 

— A an abelian scheme up to prime-to-p isogeny over T; 

- A g (NS(A) <g> Zp) /Z* the class of a prime-to-p polarization; 

- t: — > Endr(A) <8>Z( p ) a homomorphism of Z( p )-algebras with (,(&*) = here f is the 
Rosati involution associated to A; 

— fj a level structure of type C p on A; 

such that a certain determinant condition is satisfied. For precise details we refer to Kot- 
twitz [8], §5. If C p is sufficiently small, which we from now on assume, then srfgi^c is representable 
by a smooth quasi-projective Oe,v -scheme. 

3.1.3. Let B := O^/pOag. The involution * induces an involution of B which we denote by the 
same symbol. Let K be the centre of SB, let K := {z G K \ z* = z}, and let Of, and be the 
respective rings of integers. Then Op^/pO^ = k is the centre of -B and Ok/pOk = k := {z £ 
k \ z* = z}. 

Let Q p r C Qp be the maximal unramified extension of Q p . We write F p for its residue field. 
The assumptions on the data in 3.1.1 imply that v is an unramified prime, so E v C Q p r . 

Consider an algebraically closed k containing F p . As usual we write J? (resp. J?) for the set 
of embeddings of k (resp. k) into k. Using that v is unramified we get, via the chosen embedding 
Q -> Q p , natural identifications J = Hom(^, C) and J = Hom(K, C). Write J = J x U • • • U J v 
for the partition of J' corresponding to the decomposition of k as a product of finite fields. 

The choice of h € SC gives V a Q-Hodge structure of type (—1,0) + (0,-1) equipped 
with an action of SB. In particular we have a pair a SB <S)q C-modules "V^ ' C "V^. Via the 
above identifications this gives us a type (d, f) as in 1.3.2 with d constant on each of the subsets 
J'n C J? and such that (1.3.2.1) holds. This type is independent of the chosen h. 



19 



A fc-valued point of s^g,^c gives rise to a BTj with (B, *, — l)-structure Y_ by taking Y := A\p] 
equipped with its S-action, and with A: Y — > Y D the — 1-duality induced by the prime-to-p- 
polarization on A. The determinant condition mentioned in 3.1.2 implies that Y_ has type equal 
to (d,f). 

3.1.4. Lemma. — Let S be a scheme of characteristic p > 2. Let Y_ be a BT\ with (B,*,e)- 
structure over S. Let k be an algebraically closed field, char (A;) = p. For s £ S(k) let 5 S : J^ D — > 
Z/2Z be the invariant associated to Y^ s as in 1.3.6. Then the function s i— > S s is locally constant 
on S(k). 

Proof. It suffices to consider the case that S is the spectrum of a perfect valuation ring A. 
Write Q for the fraction field of A and for its maximal ideal. By Berthelot [1], we have 
a Dieudonne theory that generalizes the theory over a perfect field. (In fact, the Dieudonne 
functor is again given by taking homomorphisms into the Witt covectors.) So we have a 5-tuple 
N = (TV, F,V,L,(p) as in 1.1.3 but now with N a free A-module of finite rank. After base change 
to Q (resp. to A/tha) we retrieve the Dieudonne module of the generic (resp. special) fibre of Y_. 

We know that Ker(Fy) C Y and Kei(V Y ) C Y^ s ) are free subgroup schemes; their 
Dieudonne modules can be identified with Ker(Fjv) C N and Ker(Vjv) C N, respectively. The 
exactness of the sequences 

1 — > Ker(Fy) — > Y — ► Ker(W) — 1 and 1 — > Ker(W) — > Y — ► Ker(Fy) — > 1 

then implies, using [1], Prop. 2.4.1, that Ker(Fjv) and Ker(Vjv) are direct summands of N. 

Using Morita equivalence one reduces the problem to the case where B = k is a finite field 
with * = id K and e = +1. Then the assertion reduces to the following fact: Let iV be a free 
A-module of even rank 2q equipped with a perfect symmetric pairing ip: N x N — > A. Let L\ 
and L 2 be direct summands of N of rank q that are totally isotropic with respect to ip. Then 
dim ((Li (g) Q) n (L 2 <8> Q)) has the same parity as dim ((L x (g) A/mA) n (L 2 ® A/m/i)). □ 

3.1.5. Write s^q := ^g>,c <8) F p . The lemma implies that we can decompose £/q as a disjoint 
union of open and closed subscheme according to the value of 5, say £/ = II £#o,6- 

Fix 5. To the type (d,f,S) we associate a pair (G°,X°) as in 1.3.6. Note that, up to a 
central factor, G° can be identified with the special fibre of ^, and that X° is closely related 
to 3£ Q . We shall not attempt to make this more precise. Now our classification results of BTi 
with additional structure give rise to a generalized Ekedahl-Oort stratification 

.2*0,(5= II 4«W' 

w£W x o\W G o 

More precisely, we have a partition of £/q,5 into a disjoint union of locally closed subspaces such 
that the Zariski closure of each stratum is a union of strata. These properties were proven by 
Wedhorn in [17], generalizing results of Ekedahl and Oort in the Siegel modular case, see [13]. 

Combining Theorem 2.1.2 with [17], Theorem (6.10) we arrive at the following dimension 
formula. 

3.1.6. Corollary. - If £*b,(5 (w) ^ then all its irreducible components have dimension equal 
to £(w). 
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3.1.7. Remark. — Let 7 be a BTx with (@/p@, *, e)-structure associated to a fc-valued point 
s £ ^^(w). The automorphism group scheme Aut(Y) is in general (highly) non-reduced. In 
fact, [17], (2.7) shows that the tangent space of Aut(Y) at the identity is isomorphic to the 
tangent space of the deformation functor Def(Y). But by Serre-Tate and [17], (2.17) the latter 
is isomorphic to the tangent space of at the point s. Hence the Lie algebra of Aut(F) has 
dimension equal to dim( I e^ ) ), independent of w. Cf. Example (2.2.12). 

3.2. Some examples. 

An immediate consequence of 3.1.6 is the following. 

3.2.1. Corollary. - - There is a unique Ekedahl-Oort stratum that is open in £/o,8- There is a 
unique w G Wx°\Wqo such that the stratum s^q^{w), when not empty, is ^-dimensional. 

The open Ekedahl-Oort stratum, corresponding to the class of the longest element of Wqo , 
plays the role of the (generalized) ordinary locus in £/o,s- It is studied in detail in our paper [11]. 
The unique O-dimensional stratum (if not empty) takes the role of what in the Siegel modular 
case is called the superspecial stratum. (In the Siegel modular case it corresponds to the abelian 
varieties that are isomorphic to E 9 with E a supersingular elliptic curve). 

Already in the simplest examples we find that for moduli points A = (A, A, i, fj) in the 
"generalized" ordinary locus, the underlying abelian variety A is not necessarily ordinary in the 
classical sense. A similar remark applies to the superspecial stratum. We shall illustrate this 
with an example. 

3.2.2. We consider an example of type AL (see 2.3.2); in particular this means that there is no 
invariant 5 to consider. 

Fix PEL data as in 3.1.1 with 89 = K a CM-field of degree 2m over Q. Let K C K be 
the totally real subfield. Suppose p is a prime number that is totally inert (unramified) in the 
extension Q C K and that splits in the extension K C K. Set q := p m . Then B = Ogg/pOgg 
is isomorphic to ¥ q x ¥ q , with involution (induced by complex conjugation on 8§) given by 
(x, y)* = (y, x). Fixing such an isomorphism, every BTi with (B, *, — l)-structure is of the form 
Y_ x Y_ D , where Y_ is a BTi with F g -structure, and where the (— l)-duality X: Y x Y D — > Y D x Y 
is given by (y,rj) ^ (77, —y). In this way the study of BTi with (B, *, — l)-structure reduces to 
the study of BTi with F g -structure (without polarization). 

Via the above mechanism, a /c-valued point of £/q gives rise to a BTi with F g -structure. 
Its type (d, f) is determined by the chosen PEL data. More precisely, d = d\mg§{Y) and the 
CM-type f is determined by the choice of the ^(M)-conjugacy class C Hom(S, S^r). 

For instance, suppose m = 6 and d = 5. The set J' of embeddings of ¥ q into k = k 
is a set of 6 elements, equipped with a natural cyclic ordering. Suppose that the function 
f: J? — > {0, 1, . . . , 5} takes consecutive values 1, 3, 1, 1, and 5. (This is a random choice.) The 
BTi corresponding to the stratum of maximal dimension then corresponds to the Dieudonne 
module given in Figure 4. 

We see that in this example Y_ decomposes as a product, Y_ = Y_ 1 x • • ■ Y_ 5 , corresponding to 
the horizontal "layers" in the picture. This decomposition is not canonical but it can be shown 
that the coarser decomposition (referred to as the slope decomposition) 

Y = (Y 1 x Y 2 ) x (Y 3 x YJ x Y 5 
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i i + 1 i + 2 i + 3 i + 4 i + 5 i 



Figure 4. 

is canonical. It plays an important role in our generalization of Serre-Tate theory; we refer 
to [11] for further discussion. Note, however, that Y, the underlying BTi without additional 
structure, is not ordinary in the classical sense, i.e., it is not a product of factors Z/pZ and \i v . 
In fact, Y is a local-local group scheme. 

At the other extreme, the BTi that corresponds to the O-dimensional stratum is given by the 
Dieudonne module in Figure 5. The underlying group scheme Y is in this case indecomposable, 
quite in contrast to what happens on the superspecial stratum in the Siegel modular case. 




i i + 1 i+2 i+3 i+4 i+5 i 



Figure 5. 

A variety of different examples is obtained by choosing different CM-types f. Let us add 
that this is typical for examples of type A (cases AU or AL in 2.3.2). In examples of type C there 
is no freedom of choice for the CM- type (due to the fact that the involution is of the first kind), 
and we find that the BTi (without additional structure) occurring on the stratum of maximal 
(resp. minimal) dimension is of the form ((Z/pZ) x /U p ) s (resp. E\p] 9 , for E a supersingular 
curve), as in the classical case. 
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